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@ Integrated multi-display overlay-controlled communicating workstation. 

67) An integrated, multi-display overlay-controlled workstation 
IM) is disclosed. The present invention is particularly suitable for 
processing electronic images. A transparent energized con- 
ductive surface (5) is utilized as the primary input control device 
for the invention. The conductive surface enables the user of 
the apparatus to interact with menus, documents, pictures or 
other images on the various displays (6.7.8) as well as control 
and select various functions of the apparatus through perma- 
nent function symbols (9). Capability to communicate voice and 
date with other users and workstations also is provided. The 
present invention is mounted in a mechanical structure that can 
be manipulated as to orientation and hBight to allow optimiza- 
tion as to user physical attributes and user intended activity. 
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Description 

INTEGRATED MULTI-DISPLAY OVERLAY-) 



BACKGROUND OF THE INVENTION 

5 

1. Field of the Invention 

The present invention relates to an electronic 
image processing workstation, and more particularly 
to a workstation comprising functionally integrated 
multiple displays that are clustered under a single 10 
transparent energized conductive surface, which 
operates as an input device and a functionally 
integrated communication link. Each display is 
optimized for a particular function. The present 
invention maximizes the ability of the user to create, 15 
capture, manipulate, annotate, reproduce, file, trans- 
mit and otherwise communicate electronic imagse. 

2. Description of the Prior Art 

Since the deveiopement of the personal com- 20 
puter, computers are now used in virtually every 
business. As use of computers increased, systems 
were developed primarily to meet the specific needs 
of particular business sectors. For example, it is 
common to find in a single business computer 25 
applications for word processing, computer 
graphics, computer aided drafting, accounting, mar- 
keting data bases, project tracking, computer aided 
design, and corporate electronic publishing. How- 
ever, while many of these applications can be 30 
accomplished with interchangeable application-spe- 
cific software packages, they often utilize general 
purpose workstation hardware that is neither power- 
ful enough nor specific enough for optimum perfor- 
mance. 35 

Prior art single-display workstations also are 
limited in their lack of display flexibility. Current 
workstations do not provide for both the document 
quality of high resolution black and white displays 
and the descriptivness of multi-color graphics. 40 
Frequently in presenting information, the need 
arises to display color graphics that relate to 
displayed text. General purpose workstations are 
incapable of providing both displays on the same 
system. 45 

Another limitation of prior art workstations is that 
the often utilize screen-displayed menu-driven soft- 
ware. Though screen-menu systems make operating 
systems easier to use they have several characteris- 
tics that limit their performance, particularly in single 50 
display workstations where menu and work must 
share a single device. Screen-menu systems de- 
crease the speed of the system due to the time 
required to regenerate or reprint the screen each 
time the menu is called or released. Further, whether 55 
keyboard or mouse controlled, menu systems 
require repetitious manual movements to reach the 
desired menu level. Moreover, in screen-menu 
systems, the menu is not visible to the use prior to 
its being called. Since the menu is hidden from the 60 
user, there is no constant visual reminder of the 
potential functions offered by the system. 
Prior art workstations also fail to address the need 



LLED COMMUNICATING WORKSTATION 

for systems integration. Systems integration is 
necessary to provide users with a system that is 
both flexible in its applications, yet easy for the 
operator to learn and use. Of the current worksta- 
tions, few offer highly efficient integration of system 
functions. Current workstations generally fall in one 
of two categories: (1) systems that are highly flexible 
and accommodate a variety of applications but are 
complex and require extensive training to use; or (2) 
systems that are easy to use but are rigidly designed 
for specific applications. Prior art workstations do 
not provide highly flexible systems with complexity 
that is transparent to the user. 

Prior are workstations also lack an integrated 
real-time full-duplex communication capability. With- 
out this capability they cannot allow dispersed users 
to edit a single document as a simultaneous group 
activity. Without systems integration, workstations 
also are unable to integrate voice communications 
into the workstation. While working at a workstation, 
it is often necessary to discuss the activity in which 
the user is engaged. However, for the voice portion 
of the communication, the user must use standard 
telephone communications, which causes many 
inconveniences and delays, if a hand-held telephone 
is used, activity at the workstation is impaired due to 
stopping of activity while the user speaks, using one 
hand to hold the telephone, or inconveniently 
cradling the telephone between the ear and 
shoulder. If a speaker-phone is used, and worksta- 
tion information is being transmitted via modem, the 
two types of information are usually not syn- 
chronized. The lack of integrated of voice and data 
communications capability in the workstation prohi- 
bits the transmission of synchronized data and 
communications between workstations. 

Prior art workstations also are limited in their 
ability to display and manipulate true graphic images. 
Current workstation displays are designed for 
ASCII-code character display. These ASCII-code 
based displays place characters at fixed character 
row and column positions and cannot arbitrarily 
rotate and translate characters and cannot mix 
these characters freely with graphics. Thus, in 
electronic publishing, for example, these prior art 
displays cannot accommodate and display kerning, 
ligature, and runaround type setting, to name just a 
few specialized type sets. 

Anothe limitation of prior art work station is 
restricted size of their field of view. The field of view 
of most workstation displays Is limited to 23 cpws for 
ACH-code based systems. Since a standard hard- 
copy page is commonly 66 lines of text in length, the 
restricted field of view complicates the composition 
and modification of a standard page of text. Display 
of only 23 lines of text also increases the time and 
effort spent in moving from page to page within a 
document, as numerous keystrokes are required to 
view the entire document. 

Inherent in current workstations is the Inability to 
modify displayed images by allowing the user to 
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interact directly with the displayed image. Instead, 
users are required to use a mouse, lightpen, or 
digitizing tablet. However, these input devices 
require the user to split his attention between the 
display and the input device. The user must watch a 
display located in one place, while manually controll- 
ing an input device located elsewhere. 

Yet another limitation of current workstations is 
their inability to overlay and/or combine images, 
graphics and text. Overlaying is extremely useful in 
describing or modifying a displayed drawing. For one 
example to compare two images. For another 
example, when discussing a hardcopy drawing, it is 
often useful to graphically embellish the presenta- 
tion with a colored ink pen. Without the ability to do 
overlays and combinations, the usefulness and 
power of current workstations is greatly limited in 
such applications. 

Finally, prior art workstations generally require 
extensive preparation prior to presentation of ma- 
terial and do not readily accommodate modifica- 
tions. For example, during a presentation, a need 
often arises for graphical annotation of the subject 
material. With current workstations, the modification 
is completed only after considerable effort in 
resetting parameters and re-positioning graphics 
characters. Since most of the current workstations 
do not allow for quick real-time annotation, any 
required annotation usually cannot be completed 
during the presentation period. 

Prior art workstations also offer only a limited 
range of adjustment of display positions. Some offer 
upright displays that are difficult on which to write. 
Others offer flat displays that inhibit group viewing. 
Still others have limited freedom of height adjust- 
ment making them difficult to adapt to persons of 
differing sizes. The lack of height adjustment inhibits 
use of the workstation for both sitting and standing 
operation. As a further example of the ergonomic 
restrictiveness of prior art workstations, a typicaJ 
configuration that is suitable for word processing 
often is not suitable for computer aided drafting, 
while a typical configuration that is suitable for 
computer aided drafting often is not suitable for 
word processing. Moreover, neither of these con- 
figurations functions effectively as a lectern appara- 
tus for addressing an audience. 

Accordingly, it is an objective of the present 
invention to overcome the limitations of the prior art 
by providing an improved system with multipiay 
displays that maximizes the ability of the user easily 
to capture, create manipulate, annotate, reproduce, 
file, transmit, and otherwise communicate electronic 
images. 

Another objective of the present invention is to 
provide an overlay mode that enables overlays of any 
combination of images, graphics, or text. 

Still another objective of the present invention is 
to provide a flexible image display workstation that 
integrates voice and data communications with 
advanced image processing capability. 

Another objective of the present invention is a 
workstation which performs image editing functions 
including rotation, scaling up or down in size in either 
or both directions, cutting, pasting annotation, 



"white-out", "restoration" (to previous state), and 
other editing functions. 

Yet another objective of the present invention is a 
workstation which performs hierarchical filing, such 
5 as file drawer containiner files which contain docu- 
ments which comprises pages, including filing 
functions such as copy, move, delete, and reor- 
ganize. 

Still another objective of the present invention is a 

10 workstation which compartments image memory, 
either literally or virtually (by means of software) into 
common visual space (seen by all communication 
linked stations - all "conferees") and personal visual 
space (seen only by the individual workstation). 

15 One more objective of the present invention is a 
workstation which can be controlled from beginning 
to end of session with a stylus which can serve as: a 
function selector, a pen, an eraser, a pointer, a 
mouse, and/or a keyboard. 

20 Yet one more objective of the present invention is 
a workstation which provides a paperless editing 
facility and a paperless facsimile machine. 

Finally, it Is an objective of the present invention to 
provide a flexible image display workstation that is 

25 suitable for mounting in a mechanical structure that 
can be manipulated as to orientation and height to 
allow optimization as to user physical attributes and 
user Intended activity. 

30 SUMMARY OF THE INVENTION 

The present invention is an electronic image 
processing workstation, with functionally integrated, 
multiple displays clustered under a single transpar- 
ent energized conductive surface that operates as 

35 an Input device further integrated with a real time 
full-duplex communications capability. Each display 
is optimized for a particular function. Also located on 
the energized conductive surface are a number of 
permanent function symbols. The functions associ- 

40 ated with the symbols are initiated via a stylus 
associated with the conductive surface. As more 
fully described below, the optimized displays and the 
function symbols operative In response to the stylus 
and the conductive surface provide a powerful yet 

45 flexible workstation with significant advantages over 
prior art workstations. 

The present invention achieves the above objec- 
tives by clustering two or more functionally inte- 
grated displays under a single transparent energized 

50 conductive surface that operates as an input device. 
Such a conductive surface system is disclosed in 
U.S. Pat. No. 4.603.231 issued to L Reiffel and W. 
Jung, the disclosure of which is hereby incorporated 
by reference. This system utilizes an energized 

55 conductive surface to sense spatial coordinates-of a 
stylus with respect to the conductive surface. With 
the conductive surface comprised of a transparent 
material, it can be used as an overlay for devices 
such as video displays. With such an arrangement 

60 and proper electronic control, the stylus can be 
utilized to interact with the image on the video 
display. 

In the present invention, this conductive surface 
acts as the input control device for the cluster of 
65 displays and for the permanent function symbols. In 
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prior art applications, the conductive surface con* 
trolled only one display. However, with the novel 
arrangement of the present invention, multiple 
displays and function symbols are controlled by the 
stylus and conductive surface. The present invention 
provides the user with the unique ability to write, with 
the same familiarity and ease as using a pen, directly 
on any of a number of displayed images, as well as 
access various systems functions by directing the 
stylus to the fixed function symbols, and further to 
control the editing of these images with the same 
stylus. 

The present invention utilizes this energized 
conductive surface, together with accompanying 
stylus and electronics, to significantly improve the 
speed , accuracy, and ease of use of the displays of 
the present invention. The conductive surface 
extends over and (optionally) past the surfaces of a 
cluster of functionally integrated displays. The 
operator can make menu selections from the various 
displays using the stylus of the present invention, or 
the operator can write on and/or edit any of the 
display images. This includes cutting and pasting of 
documents and images; pointing to or erasing 
particular portions of a document or image; rotation 
of images; scaling of images; and restoring to a 
previous state the modified document or image. In 
addition, using the stylus of the present invention, 
actual user handwriting can be displayed, stored and 
retrieved, either alone or in association with dis- 
played documents or images. Thus, the present 
invention can be used as an electronic chalkboard 
that is simultaneously viewable at the various 
workstation locations. 

The efficiency of the present invention is in- 
creased by permanently providing frequently used 
menu and system control functions on the work 
surface. These functions are permanently silk- 
screened on the conductive surface convering the 
work surface. Using coordinate comparison, the 
control system of the conductive surface of the 
present Invention uses the stylus and conductive 
surface to sense when the stylus Is directed towards 
a particular symbol. When the control system senses 
that the stylus is near a particular symbol, it initiates 
the function associated with that symbol. These 
permanent functions and controls provides a num- 
ber of benefits. They eliminate the need to search 
various menu levels for the appropriate menu 
function. This facilitates the editing of documents or 
images as well as the editing and manipulation of 
directories, files and other high level data con- 
structs. Moreover, they have no screen regeneration 
time delay associated with their access. Finally, 
these menu functions serve as a permanent visual 
reminder of the system capabilities. The permanent 
functions are identified by an easy to recognize 
symbol, which are easier to recognize and remem- 
ber than cryptic menu keywords. Users with little or 
no training are able to initiate the desired functions 
by directing the stylus to the appropriate symbols. 

The present invention can also simultaneously 
display directory listings (on the menu display) and 
work images (on the other displays) eliminating the 
need for windowing and for printed directory listings. 



Also with the present invention, the displays 
clustered under the conductive surface can be 
optimized for specific purposes. For example, one 
display can be dedicated for menu display. This 
5 allows permanent display of at least one menu level, 
which can include document directories, for easy 
reading of the menu typography and icons and 
available documents. This display can be black-and- 
white, (two-tone) non-interlated, and have high-res- 
10 olution. Another display can be utilized primarily for 
document display. This display is chosen to allow 
permanent display of the subject document in a very 
high resolution black-and-white (two-tone) mode. 
Still another display can be a dedicated color display. 
15 This allows the display of graphic material with color 
and/or grey-scale (multiple) (multiple tone is the 
digital equivalent of continuous tone). 

In the preferred embodiment, each of the displays 
clustered under the conductive surface performs a 
20 specific function within the system, either alone or in 
combination with other displays. For example, one 
display is designed for high resolution black and 
white capabilities. This display is particularly suitable 
as a display for documents, other forms of text and 
25 other images that require a high degree of legibility 
but do not require multiple-tone or color. Display 
size is such as to provide display of a full sized 
standard page of text The page of text in the 
present invention is the complete hardcopy page, 
30 reproduced without scaling, and is not restricted to 
23 rows as are the ASCII-code based systems 
known in the prior art. 

Another display In the preferred embodiment is 
used exclusively for screen display menu commands 
35 and for the image directory listings. This separate 
menu display allows for retention of the advantages 
of menu driven systems, while avoiding work 
display-menu display conflicts and work display-di- 
rectory display conflicts. With this separate menu 
40 display, the number of regenerations of menus and 
work images is significantly reduced compared to 
number of regenerations for standard menu sys- 
tems. Also, since the menu display has less total bits 
than the very high resolution display these regener- 
45 ations which are required will be much faster. 

A third display is provided for the display of high 
resolution color graphics and captured images. The 
user can control this display via the conductive 
surface to annotate a displayed captive image. Color 
50 and grey level graphics annotation are available with 
this display. The combination of the three displays 
gives the user a combination of display functions 
and resolution levels to meet the requirements of 
most applications. For example, the viewer can 
55 simultaneously review text and a related^picture, 
much like viewing the text and picture in a magazine 
article. As other example, the color display can be 
used to display the portrait of the individual 
presenting the document or verbal communication, 
60 thereby displaying the author/speaker at the various 
locations in teleconferencing applications. Such 
flexibility Is not found in prior art workstations. 

The present invention provides a highly integrated 
system that provides the user with a system that is 
65 powerful and flexible, yet is easy to learn and use. An 
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example of this integration can be seen in the 
integrated use of the energized conductive surface 
as an input device for both the cluster of displays 
and the permanent function symbols. Selected 
displays within the cluster of displays have also been 
integrated. For example, the menu display and the 
high resolution display are integrated to provide the 
advantages of a high resolution display and a system 
menu display without the time delay that would result 
if both of these functions were present on a single 
display. 

An analog and digital full-duplex communication 
subsystem further integrates with displays and 
control surfaces. 

As a further example of the flexibility of the 
present invention, a document directory can be 
displayed on the menu display, while documents are 
displayed on the document display. Using the stylus 
as a pointer, the user can point to a document listed 
in the directory, while simultaneously viewing that 
document on the document display. 

The present invention provides integration capa- 
bilities that allow the user to utilize the system in a 
wide range of applications. Functions such as 
facsimile transmission capability, the capability to 
use multiple storage media, the ability to use a 
variety of communications channels, the real-time 
voice, data, and video communications allow the 
user extensive system flexibility. Two or more 
systems can link to allow fully-interactive real time 
distributed conferencing and editing wherein dis- 
persed users can work cooperatively on images 
viewed by all of them. For example, users at various 
locations can interact with and simultaneously view 
the same image, while cooperatively manipulating 
the image, with changes to the image made at one 
workstation instantaneously viewed by the users at 
all workstations. The present invention thus provides 
a highly flexible integrated system whose complexity 
is transparent to the user. 

In addition to integrating voice communications, 
the present invention uses a a hands-free voice 
subsystem. The hands-free voice subsystem gives 
the user the freedom to continue non-interrupted 
work on the work surface while continuing to talk. 
The hands-free voice subsystem is fully syn- 
chronized with the other portions of the trans- 
mission. The synchronized and integrated voice 
subsystem permits real-time synchronized worksta- 
tion communications activities. 

The present invention also allows for the display of 
real images. Image input formation is received from 
an electronic image pickup device. The present 
invention captures the image and is capable of filing 
the image in an electronic image memory system. 

These images can include portraits and these 
portraits can be selectively displayed according to 
the person who is peaking and/or writing. 

The present invention also is capable of free 
floating character positions and can arbitrarily mix 
characters freely with graphics suiting it to graphics 
art creation and to electronic publishing. This 
workstation is capable of accommodating many 
complex styles of typesetting such as kerning, 
ligature, and runaround, thus suiting it well to 



electronic publishing uses. 

Moreover, an image filed in the system can be 
quickly overlayed on top of other images filed in the 
system. Graphics also can be quickly overlayed on 

5 top of a displayed image by drawing on the screen 
on which the image is displayed. The overlay can 
then be stored or permanently copied onto the 
original. This technique also can be utilized for 
multiple images. 

10 The packaging of the present invention allows 
quick and easy adjustments that custom fit the 
system to the physical attributes of the user and the 
specific configuaration requirements for the particu- 
lar application. Adjustments can be made to the 

15 angle and the vertical height of the work surface. A 
wide range of angular adjustments allows one to 
choose the most comfortable and efficient work 
surface angle. Vertical adjustments are provided, 
ranging from seated-use desk height, to standing- 

20 use lectern height, to accommodate most users and 
most applications, 

BRIEF DESCRIPTION OF THE DRAWINGS 
A better understanding of this invention may be 
25 gained from a consideration of the following descrip- 
tion, presented by way of example, with reference to 
the accompanying drawings in which; 

FIG. 1 is an illustration of the workstation. 
FIG. 2 Is a block diagram of the workstation 
30 system. 

FIG. 3 is a diagram of the workstation 
worksurface showing the location of the dis- 
plays and the permanent function symbols. 
FIG. 4 is a right side view of the minimum/ 
35 maximum adjustments of the workstation. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 
In describing the preferred embodiment of the 

40 invention illustrated in the drawings, specific termi- 
nology will be resorted to for the purpose of clarity. 
However, It is not intended to be limited to the 
specific terms as selected and it is to be understood 
that each specific term is inclusive of technical 

45 equivalents that operate in a similar manner to 
accomplish a similar purpose. 

FIG. 1 illustrates an overview of the preferred 
embodiment of the present invention. In the 
preferred embodiment, electronic image processing 

50 workstation 1 comprises a worksurface 2, an upper 
console housing 3, a lower console housing 4, a 
supporting base 10, an energized conductive sur- 
face 5 that extends under work surface 2, a still 
picture display 6, a high resolution display 7, a menu 

55 display 8, and genera! groupings of permanent 
function symbols generally denoted by 9. 

Conductive surface 5, located below work surface 
2, functions as a user interface to workstation 1. 
Mounted within upper console housing 3 and 

60 beneath the surface of conductive surface 5 are 
workstation displays 6. 7 and 8, which, in the 
preferred embodiment, are commercially available 
video display monitors. The functions associated 
with permanent function symbols 9 are initiated by 

65 directing stylus 5A towards conductive surface 5 at 
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the respective location of the particular function 
symbol. Thus, stylus 5A and conductive surface 5 
are the controlling input devices for function sym- 
bols 9. Function symbols 9 are permanently affixed 
to conductive surface 5, such as by a silk screen 
process. Other methods of permanently marking 
function symbols 9, such as adhesive labels and 
etching could, be used in other embodiments. The 
chosen silk screen method provides for placing 
function symbols 9 in a convenient, permanent and 
repeatable position on conductive surface 5. 

The supporting frames (not explicitly shown) for 
console housing 3. lower console housing 4 and 
work surface 2 are fabricated from a rigid material 
such as plastic or sheet metal, which is formed and 
mounted to a structural frame (not explicitly shown) 
of conventional design. Upper console 3 is angularly 
adjustable relative to lower console 4. Lower 
console 4 is linearly adjustable in the vertical 
direction. In the preferred embodiment, there adjust- 
ments are executed with the assistance of built-in 
electric motors (not explicitly shown) and actuators 
(not explicitly shown) of conventional design. In 
other embodiments, these adjustments are ex- 
ecuted by using other well-known forms of mechan- 
ical, hydraulic, or vacuum systems. 

FIG. 2 is a block diagram of the electronic system 
of workstation 1. An audio I/O unit 10 communicates 
with the main system bus 20. receives signals from 
microphone 32, and drives speaker(s) 33. In the 
preferred embodiment, microphone 32 is Model No. 
BT1759 manufactured by Knowles Co., the reference 
and operating manuals for which are hereby incor- 
porated by reference. Also in the preferred embodi- 
ment, speaker(s) 33 is (are) Model No. 84BP01 
manufactured by Mura, the reference and operating 
manuals for which are hereby incorporated by 
reference. Audio I/O unit 10 also receives audio 
(voice) signals from external (plug-In) microphone 
32 and plug-In headset 101 and drives external 
earphones 101 and speakers 33. In the preferred 
embodiment, headset and earphones 101 are Star- 
Mate Model E. manufactured by Plantionics, the 
reference and operating manuals for which are 
hereby incorporated by reference. 

Audio I/O unit 10 supports hands-free voice 
communication over the general switched telephone 
network (also referred to as the dial network) by 
interfacing with speakerphone 105. Speakerphone 
105 is of conventional design, and connects to 
telephone line 109 in a conventional manner. In the 
preferred embodiment, speakerphone 105 is a 
Model 800SP manufactured by NTT, the reference 
and operating manuals for which are hereby incor- 
porated by reference. 

Audio I/O unit 10 also supports hands-free voice 
communication over digital network 117 by interfac- 
ing with digital communication unit 113. Digital 
communication unit 113 known in the art, and, in the 
preferred embodiment is, manufactured by N.T.T. 
Corporation, the reference and operating manuals 
for which are hereby incorporated by reference. 
Communication unit 113 provides the necessary 
coding/decoding function and signal protocol con- 
version that enables audio I/O unit 10 to interface 



digital network 117. Digital Network 117 can be, for 
example, the Japanese ISN Network, or any CClTT 
ISDN. 

Under control of the main CPU unit 16, which 
5 receives user commands from conductive surface 
21 (the stylus and spatial coordinate sensing 
system, such as described in L. Reiffel and W. Jung, 
U.S. Pat. No. 4,603,231, the disclosure of which is 
hereby incorporated by reference), audio I/O unit 10 
W controls muting, microphone and speaker selection, 
and similar audio functions for headset 101, micro- 
phone 32 and speaker 33, for example. 

Communications unit 11 interfaces the main 
system bus 20 to digital communication unit 113. 
15 Digital communication unit 113 establishes connec- 
tion with digital network 117, thereby enabling digital 
communications between main system bus 20 and 
digital network 117 through communication unit 11. 
Special function unit 12 performs hardware-as- 
20 sisted data manipulations that allow the system, 
under control of main CPU unit 16, in turn controlled 
by the user through conductive surface 121. to 
perform transformations on or between any of the 
three display images: menu, high resolution, and still 
25 picture by causing data to flow from the respective 
display memory (not explicitly shown) through 
special function unit 12. Special function unit 12 
manipulates the image data and returns it in altered 
form to the same or a different location in either the 
30 same or different display memory. 

Mass storage unit 13 provides secondary digital 
memory in the form of hard disc (e.g. - Winchester), 
magnetic diskette, and magnetic tape or other 
conventional digital storage technologies. In the 
35 preferred embodiment, main storage unit 13 inter- 
faces disk drive 13A and tape unit 13B to main 
system bus 20. Also in the preferred embodiment, 
disk drive 13A is Model D5146 manufactured by 
NEC, and tape unit 13B is Floppy Tape IS1020 
40 manufactured by Interdyne, the reference and 
operating manuals for which are hereby incorpor- 
ated by reference. Main storage unit 13 interfaces 
memory units 13A and 13B In a conventional manner 
to main system bus 20. 
45 Power supply 14 is of conventional design and 
receives a.c. power from the main power source and 
transforms it to rectified and filtered d.c. voltages 
that are suitable for the circuits of workstation 1. In 
the preferred embodiment, power supply 14 is 
50 Model No. HS300-01 manufactured by Koby Electro- 
nics, the reference and operating manuals for which 
are hereby incorporated by reference. Power supply 
14 has a standby (or sleep mode) low power mode 
that allows workstation 1 to monitor the communica- 
55 tion lines, such as telephone line 109 and digital 
network 1 1 7, and repond to remote requests but to 
consume lower amounts of power than when In the 
normal "on" state, with all components active. 
Menu video unit 15 comprises the display electro- 
de nics for display 125, which, in the preferred embodi- 
ment, is a 13-inch (diagonal) monochrome display. In 
the preferred embodiment, display 125 is a 13 inch 
15V4972-OOM Monitor manufactured by Wells Gar- 
dener, the reference and operating manuals for 
65 which are hereby incorporated by reference. In the 
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preferred embodiment, display 125 primarily is used 
to display screen menus and directory listings. The 
combination of menu video unit 15 and display 125 
constitute a full display system. Menu video unit 15 
comprises conventional video control electronics 
memory for the video display. Display 125 converts 
the electronic signals from menu video unit 15 to a 
visual display by scanning an electron beam across a 
phosphor screen in a conventional manner. The 
menu display is 1024 pells across by 393 pels 
vertical, one-bit per pel, operating non-interlaced. 

The menus displayed on the display 125 are 
visually located under conductive surface 121. 
Because conductive surface 121 is transparent, the 
image on display 125 is visible to the user. The user 
is thus able to make menu selections by directing 
stylus 121 A over the appropriate menu legend or 
icon and touching stylus 121 A to conductive surface 
121 (the work surface of the workstation). Conduc- 
tive surface 121, senses the coordinates of stylus 
121 A, and transmits these coordinates and the 
information that stylus 121 A has touched conductive 
surface 121 to the main CPU 16. Using a coordinate 
comparison look-up table technique, main CPU unit 
16 interprets the coordinates as a selection of the 
new command represented by the new legend or 
icon. The selected command is then executed by 
main CPU 16. This menu display function is op- 
timized for the display of menus with legends and 
icons in easy-to-read and attractive form, thereby 
facilitating user recognition and operation. 

As illustrated in FIG. 2, the menu video unit 15 
receives data and control signals through the main 
system bus 20. 

In the preferred embodiment, the high resolution 
video unit subsystem 129, comprises high resolution 
video unit 17 and display 133. High resolution video 
unit 17 functions in a manner similar to menu video 
unit 15. In the preferred embodiment, disply 133 is a 
17" monochrome display, model 
VX1500-T17-P164-IE-SPS manufactured by Mon- 
term, the reference and operating manuals for which 
are hereby incorporated by reference. Display 133 is 
vertically oriented (portrait style), as opposed to the 
horizontally oriented (landscape) display 125. High 
resolution subsystem 129 supports a 1728 pel 
across by 2368 pelvertical display, consisting of a 
single bit of memory (on-off; white-black) per pel. 
This display subsystem is functional optimized for 
documents displayed in group 3 and group 4 (CCITT) 
facsimile formats. 

The data for the images to be displayed on display 
133 are communicated to the high resolution video 
subsystem 129 (and high resolution video unit 17) via 
main system bus 20 in a conventional manner. 

High resolution video subsystem 129 primarily is 
used for the display and manipulation (editing, 
annotation, etc.) of document images. As with 
display 125, display 133 lies under conductive 
surface 121. The user places stylus 121 A on 
conductive surface 121 (workstation surface) at a 
point over the image to be edited or manipulated. 
The functions to be performed on the portion of the 
image are selected by the user through stylus 121 A 
by making selections of the permanent function 



symbols 9 (of FIG 1) (as more fully described below) 
or on menu functions typically displayed on display 
125. 

Still picture subsystem 137, comprising still pic- 

5 ture unit 18, display 141 and color camera 145, is 
functionally optimized for the display of images that 
either or both color or continuous tone (grey scale). 
In the preferred embodiment, display 141 is a 13-inch 
(diagonal) color display CRT monitor, model 

W CM4000, manufactured by Motorola, the refernece 
and operating manuals for which are hereby incor- 
porated by reference. Display 141 is horizontally 
(landscape) oriented. Also in the preferred embodi- 
ment, the components of subsystem 137 are 

75 functionally optimized for the display of images that 
have either or both color or continuous tone (grey 
scale). Still picture unit 18 supports 640 pels across 
by 480 pels vertically with one byte of data per pel. 
Camera 145 allows video pictures to be captured by 

20 still picture unit 18, which digitizes these pictures 
and stores them in its video memory (not explicitly 
shown). In the preferred embodiment, camera 145 is 
a Model No. DXC-3000 manufactured by Sony Corp., 
the reference and operating manuals for which are 

25 hereby incorporated by reference. 

Still picture subsystem 137 communicates with 
the other components of workstation 1 via main 
system bus 20 in a conventional manner. Stylus 121 A 
and conductive surface 121 are used to interact with 

30 the image on display 141 as with high resolution 
subsystem 129 and display 133 as described above. 

Interface unit 19 is a conventional circuit that 
interfaces main system bus 20 with image scanner 
printer 149. In the preferred embodiment, scanner 

35 printer 149 is a Model NP9030 manufactured by 
Canon, the reference and operating manuals for 
which are hereby incorporated by reference. Scan- 
ner printer 149 acts as both an input and an output 
device for workstation 1. Scanner printer 149 scans 

40 paper-based images that are inserted therein and 
supplies an electronic image data equivalent of the 
paper image to Interface unit 19. Interface unit 19 
communicates the image data to main system bus 
20 for storage in either the memory of high 

45 resolution video unit 17, or alternatively in the 
memory of main CPU unit 16 or in the secondary 
memory interfaced via main storage unit 13. 

Images from any memory in workstation 1 can be 
transmitted via main system bus 20 to interface unit 

50 19, and from there to scanner printer 149 for 
conversion to a hard copy. 

Other input devices using conventional formats 
can be attached via appropriate interface units to the 
main system bus 20 In a conventional manner. Other 

55 output devices also may be attached to worksta- 
tion 1 using suitable interface units from either main 
system bus 20 or the display system video outputs 
153, 157, and 161 of display 125, 133 and 141, 
respectively. 

so FIG. 3 illustrates of workstation work surface 2 
showing the location of the displays 6, 7, and 8 (also 
numbered 141. 133, and 125, respectively, in FIG. 2) 
as well as the locations and groupings of the 
permanent function symbols 20-31. While the 

65 preferred embodiment utilizes three displays and 
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permanent function symbols illustrated in FIG. 3, 
other configurations and quantities of displays and 
permanent function symbols are possible and lie 
within the spirit of the invention, and are utilized in 
alternative embodiments. 

The present invention provides significant oper- 
ational improvements over the prior art in its 
selection and integration of the subsystems of 
workstation 1. Specifically, in the integration of 
multiple displays on a single visual surface that the 
operator controls via a transparent conductive 
surface and stylus. 

The present invention physically provides displays 
125,133 and 141 in a plane (work surface 2 of FIG. 3), 
thus establishing a desirable work and control 
surface. The work surface can be physically manipu- 
lated to accommodate the differing personal at- 
tributes of the user and differing task requirements 
of the specific activity. It combines a conductive 
surface interface that facilitates care of user oper- 
ation with the work surface. The conductive surface 
extends over all of the displays and beyond, thus 
creating surface area for permanent function sym- 
bols, further facilitating ease of use of the present 
invention. The present invention unifies and inte- 
grates the control of all system operations and 
controls onto and through this single conductive 
surface. 

Visually, the displays are integrated by their 
position in a single plane, and the integrated 
conductive surface control system that operates 
them in a unified fashion. The images are integrated 
and coordinated through this same unified conduc- 
tive surface control system. 

For example, the permanent function symbols are 
used to select image editing modes. This causes a 
directory of image pages to appear on the menu 
display monitor. A pointer on that directory points to 
a specific directory entry, and the corresponding 
page is displayed on the document display or the still 
picture display, as may be appropriate according to 
whether the page is color (or continuous tone) or 
document (two-tone). The permanent function sym- 
bols are stylus selected to cause the directory 
pointer to advance (paging forward) and the pointer 
advances and simultaneously the next page is 
displayed on the appropriate display. 

Images and displays are further integrated in that 
they may be transported in whole or in part between 
displays. Where the displays are of the same type, as 
in the case of menu and document displays, this can 
be a straightforward electronic transfer of the image 
data. Where the image type differs, as in the case of 
document and still picture displays, the transfer 
Involves a manipulation between document and 
color/continuous tone formats. These transforma- 
tions are performed in a conventional manner by 
special function unit 12 and main CPU unit 16, 
appropriately communicating through main system 
bus 20. 

Images reside in either personal visual space or 
common visual space. This distinction can be either 
physical or virtual. The CPU and its software divide 
the memory into common visual space and personal 
visual space. Common visual space includes images 



that all of the linked workstations can view. Personal 
visual space includes images that can be viewed 
only by the workstation where they are stored. This 
division is accomplished through standard memory 
5 partitioning techniques. 

Referring again to FIG. 3, conductive surface 5 of 
work surface 2 integrates the selection of the 
permanent function symbols 20-31 with selections 
made from the displays 6, 7 and 8. The versatile 
10 application of conductive surface 5 is accomplished 
by selectively allocating response capabilities to 
areas of conductive surface 5 occupied by either the 
permanent function symbols or the screen areas of 
displays 6, 7 and 8. Touching stylus 121 A (of FIG. 2) 
15 to the response enabled area of a particular function 
results in the control of the corresponding screen 
area or function symbol. Stylus 121 A is thus used for 
selecting from the permanent functions and controls 
offered by the system, including functions creating 
20 and controlling communication links with other 
systems, for selecting from menus appear on 
displays 6, 7 or 8 screens, and for annotating or 
editing images that appear on displays 6, 7 or 8. 
Thus, all work applications have been integrated 
25 through stylus 121 A and conductive surface 5. 

Permanent function symbols 20-27, 29-31 of FIG. 3 
are grouped and positioned so as to positionally 
coordinate with the screen that they control. The 
permanent function symbols of the preferred em- 
30 bodiment will be further described. Color function 
symbols 20 permit the assignment of 1-of-8 different 
colors for annotations executed on the 640V x 480H 
pels still picture display 6. Color function symbols 20 
are much like a color palette, and the user can select 
35 the desired color by touching the stylus to the 
appropriate color function symbol. Page operation 
function symbols 21 control the still picture display 6 
image page operations. Basic entry level functional 
area controls 22 control the image edit, conference, 
40 input/output, directory edit, and session, and utility 
functions. The following controls are provided: the 
print screen command 23, audio mute 24. and help 
menus 25, without requiring the user to descend into 
or disturb the various functional areas or menu 
45 levels. Screen controls 26 for the single screen 
mode (as opposed to the split mode) of high 
resolution display 7 Include 8-way scroll functions, 
page forward/reverse, and page mark and retrieval. 
Split screen controls 27 provide an independent set 
50 of controls for the second image created when the 
split screen mode is activated. The abort control 28, 
teleconferencing files 29, and memoranda controls 
30 are general functions that service displays 6, 7 
and 8. These controls are primary menu levels and 
55 are located near the menu display to simplify the use 
when controlling menu display 6. Overlay control 
symbol 31 allows the user to overlay other images on 
top of the Image displayed on high resolution 
monitor 7. 

60 Microphone 32 and speaker 33 (shown in FIG. 2) 
permit the operator of workstation 1 to utilize the 
hands-free audio communications. The audio oper- 
ation of the present invention is acoustically acti- 
vated, which gives the operator independence from 

65 manually controlling both a stylus and a telephone. 



8 



15 



0 262 991 



16 



Thus, the operator is able to communicate verbally 
and visually without complication or disruption of the 
workstation activity. 

Referring now to FIG. 4, a right side view of 
workstation 1 is provided to illustrate the range of 
adjustments available with the present invention. 
The below described physical adjustments are 
accomplished with conventional motors and actua- 
tors, in a conventional manner. FIG. 4(a) illustrates 
workstation 1 with lower console 4 in the maximum 
vertical height adjustment 34 in combination with 
upper console 3 and work surface 2 maximum 
angular adjustment 35 relative to a horizontal 
reference line. FIG 4(b) illustrates workstation 1 with 
lower console 4 in the minimum vertical height 
adjustment 2 minimum angular adjustment 37 
relative to a horizontal reference line. Any combina- 
tion of adjustments, workstation height and work 
surface angle, are possible within the range of these 
minimum/maximum angle and height limits. Thus, 
the present invention can be adjusted in height and 
position to accommodate a range of user physical 
attributes and a range of applications. 

In addition, the teachings and principles of U.S. 
Pat. No. 3,671,668, issued to L. Reiffel, U.S. Pat. 
No. 3,718,759, issued to L. Reiffel, U.S. Pat. 
No. 3.617,630, and co-pending U.S. Pat. App. Ser. 
No. 515,762 are applicable to the present invention, 
and the disclosures of each of these references is 
hereby incorporated by reference. 

While the preferred embodiment of the invention 
has been illustrated and described, it is to be 
understood that the invention is not limited to the 
precise construction herein disclosed, and the right 
is reserved to all changes and modifications coming 
within the scope of the invention as defined in the 
appended claims. 

The foregoing description and the drawings are 
regarded by the applicant as including a variety of 
individually inventive concepts, some of which may 
lie partially or wholly outside the scope of some or all 
of the following claims. The fact that the applicant 
has chosen at the time of filing of the present 
application to restrict the claimed scope of protec- 
tion in accordance with the following claims is not to 
be taken as a disclaimer of alternative inventive 
concepts that are included in the contents of the 
application and could be defined by claims differing 
in scope from the following claims, which different 
claims may be adopted subsequently during pros- 
ecution, for example for the purposes of a divisional 
application. 



Claims 

1. An apparatus for processing video images 
comprising: 
multiple display means ; 

function symbols wherein each symbol is 
associated with a particular apparatus function; 
spatial coordinate sensing means, wherein the 
sensing means is operationally positioned bet- 
ween each of the display means and function 



symbols and the apparatus user; 

stylus means functionally related the sensing 

means; and 

wherein the apparatus is responsive to the 
5 position of the stylus with respect to the 

sensing means. 

2. The apparatus of claim 1 further compris- 
ing communication means. 

3. The apparatus of claim 1 further compris- 
10 ing mechanical adjustment means for altering 

the height and orientation of the apparatus. 
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